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-Abstract- 

Kleisli simulation is a categorical notion introduced by Hasuo to verify finite trace inclusion. They 
allow us to give definitions of forward and backward simulation for various types of systems. A 
generic categorical theory behind Kleisli simulation has been developed and it guarantees the 
soundness of those simulations wrt. finite trace semantics. Moreover, those simulations can be 
aided by forward partial execution (FPE)—a categorical transformation of systems previously 
introduced by the authors. 

In this paper, we give Kleisli simulation a theoretical foundation that assures its soundness 
also wrt. infinite trace. There, following Jacobs’ work, inhnite trace semantics is characterized 
as the “largest homomorphism.” It turns out that soundness of forward simulations is rather 
straightforward; that of backward simulation holds too, although it requires certain additional 
conditions and its proof is more involved. We also show that FPE can be successfully employed 
in the inhnite trace setting to enhance the applicability of Kleisli simulations as witnesses of trace 
inclusion. Our framework is parameterized in the monad for branching as well as in the functor 
for linear-time behaviors; for the former we use the powerset monad (for nondeterminism) as well 
as the sub-Giry monad (for probability). 
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[T] Introduction 

Language inclusion of transition systems is an important problem in both qualitative and 
quantitative verification. In a qualitative setting the problem is concretely as follows: for 
given two nondeterministic systems X and y, check if L{X) C L{y) —that is, if the set of 
words generated by X is included in the set of words generated hy y . In a typical usage 
scenario, T is a model of the implementation in question while 3^ is a model that represents 
the specification of X. More concretely, 3^ is a system such that L{y) is easily seen not to 
contain anything “dangerous”—therefore the language inclusion L{X) C L{y) immediately 
implies that L{X) contains no dangerous output, either. Such a situation can also arise in 
a quantitative setting where a specification is about probability, reward, and so on. 
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Figure 1 Examples of nondeterministic and probabilistic automata 
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Coalgebraic Infinite Traces and Kleisli Simulations 


► Example 1.1. In Fig. are four examples of transition systems; X and y are qualita- 
tive/nondeterministic; Z and W exhibit probabilistic branching. We shall denote the finite 
language of a system A by L*{A) and the infinite one by L°°{A). We define that a generated 
finite word is one with a run that ends with the termination symbol /. 

In the nondeterministic setting, languages are sets of words. We have L*{X) = {6} C 
{b,ab,aab,...} = L*{y), i.e. finite language inclusion from X to y. However abb... G 
L°°{X) while abb... ^ L°°{y), hence infinite language inclusion fails. 

In the probabilistic setting, languages are naturally probability distributions over words; 
and language inclusion refers to the pointwise order between probabilities. For example 
L*{Z) = [&!—>■ g, &a I—>■ rX^baa i—)■ and L*{W) = [6 i—>■ 6a i—>■ |, baa i—>■ since 

the former assigns no greater probabilities to all the words, we say that the finite language 
of Z is included in that of W. This quantitative notion of trace inclusion is also useful in 
verification: it gives e.g. an upper bound for the probability for something bad. 

Finally, the infinite languages for probabilistic systems call for measure-theoretic machin¬ 
ery since, in most of the cases, any infinite word gets assigned the probability 0 (which is 
also the case in Z and W). Here it is standard to assign probabilities to cylinder sets rather 
than to individual words; see e.g. [ 3 ]. An example of a cylinder set is {aw \ w G {6, c}'^}. 
The language L°°{Z) assigns | to it, while L°°{yV) assigns 0; therefore we do not have 
infinite language inclusion from Z to W. 

There are many known algorithms for checking language inclusion. A well-known one 
for NFA is a complete one that reduces the problem to emptiness check; however it involves 
complementation, hence determinization, that incurs an exponential blowup. 

One of the alternative approaches to language inclusion is by simulation. In the 
simulation-based verification we look for a simulation, that is, a witness for stepwise lan¬ 
guage inclusion. The notion of simulation is commonly defined so that it implies (proper, 
global) language inclusion—a property called soundness. Although its converse (complete¬ 
ness) fails in many settings, such simulation-based approaches tend to have an advantage 
in computational cost. One prototype example of such simulation notions is forward and 
backward simulation |21j . by Lynch and Vaandrager, for nondeterministic automata. They 
are shown in |2I] to satisfy soundness wrt. finite trace: explicitly, existence of a forward (or 
backward) simulation from X to y implies L(X) C L(y), where the languages collects all 
the finite words generated. 

Kleisli simulation [niiiaiis] is a categorical generalization of these notions of forward 
and backward simulation by Lynch and Vaandrager. It builds upon the use of coalgebras in 
a Kleisli category^ in m, where they are used to characterize finite traces. Specifically: 

B A branching system X is represented as an F-coalgebra c : A -o- FX in the Kleisli 
category Ki(T), for a suitable choice of a functor F and a monad T. Here F and T 
are parameters that determine the (linear-time) transition type and the branching type, 
respectively, of the system X. Examples are: 

_ F = 1 -\- X X (_) (terminate, or (output and continue)) and the powerset monad 
T = V on Sets (nondeterminism), if V is a nondeterministic automaton (with explicit 
termination); and 

- the same functor F = 1-l-S x (_) and the sub-Giry monad T = gm on the category 
Meas of measurable spaces and measurable functions, for their probabilistic variant. 
H In |Ifi| . under certain conditions on F and T, it is shown that a final F-coalgehra in 
K£(T) arises as a lifting of an initial E-algebra in Sets. Moreover, it is observed that 
the natural notion of “finite trace semantics” or “(finite) languages” is captured by a 
unique homomorphism via finality. This works uniformly for a wide variety of systems. 
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by changing F and T. 

It is shown in m that, with respect to this categorical characterization of finite trace m, 
both forward and backward Kleisli simulation are indeed sound. This categorical background 
allows us to instantiate Kleisli simulation for various concrete systems—including both qual¬ 
itative and quantitative ones—and obtain simulation notions whose soundness wrt. finite 
traces comes for free [HUS]. Like many other notions of simulation, the resulting simula¬ 
tion sometimes fails to be complete. This drawback of incompleteness wrt. finite trace can be 
partly mended by forward partial execution (FPE), a transformation of coalgebraic systems 
introduced in m that potentially increases the likelihood of existence of simulations. 

Contributions In this paper we continue our series of work m US! US] and study the 
relationship between Kleisli simulations and infinite traces. This turns out to be more 
complicated than we had expected, a principal reason being that infinite traces are less 
well-behaved than finite traces (that are characterized simply by finality). 

For a suitable coalgebraic characterization of infinite traces we principally follow m- 
also relying on observations in mm — and characterize infinite traces in terms of largest 
homomorphisms. More specifically, we lift a final E-coalgebra in Sets to the Kleisli cate¬ 
gory KI(T) and exhibit that the latter admits a largest homomorphism. In this paper we 
(principally) work with: the powerset monad V (on Sets) and the sub-Giry monad Q (on 
Meas), as a monad T for branching; and a polynomial functor F for linear-time behaviors. 

Here are our concrete contributions. For each of the above combinations of T and F\ 

H We show that forward Kleisli simulations are sound with respect to inclusion of infinite 
languages. The proof of this general result is not hard, exploiting the above coalgebraic 
characterization of infinite languages as largest homomorphisms. 

H We show that backward simulations are sound too, although here we have to impose 
suitable restrictions, like totality and image-finiteness. The soundness proofs are much 
more involved, too, and calls for careful inspection of the construction of infinite trace 
semantics. The proofs are separately for T = V and for Q. 

H We show that forward partial execution (FPE)—a transformation from [25] that aids 
discovery of fwd./bwd. simulations—is applicable also to the current setting of infinite 
trace inclusion. More specifically we prove: soundness of FPE (discovery of a simulation 
after FPE indeed witnesses infinite language inclusion); and its adequacy (FPE does not 
destroy simulations that are already there). 

Organization ^is devoted to categorical preliminaries; we fix notations there. In ^we 
review the previous works that we rely on, namely coalgebraic infinite trace semantics m, 
Kleisli simulation [Hdllli], and FPE [25]. Our technical contributions are in the subse¬ 
quent sections: in ^we study the nondeterministic setting (i.e. the powerset monad V on 
Sets and a polynomial functor E); f] is for the probabilistic setting (where the monad T 
is the sub-Giry monad Q). In f] we briefly discuss other monads like the lift monad C (for 
divergence) and the subdistribution monad T> on Sets (for discrete probabilities). 

Some definitions and results in ^4]^are marked with f. Those marked ones are essentially 
proofs of the results for specific settings (namely T — V and T — Q) but formulated in general 
terms with a general T. We do so in the hope that the axioms thus identified will help to 
discover new instances. 

Most proofs are deferred to the appendices, where auxiliary definitions and examples are 
also found. 
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Preliminaries 

► Definition 2.1. A polynomial functor F on Sets is defined by the following BNF notation: 
F ::= id I A I Fi X Fa I Fi. Here A G Sets and / is a countable set. 

The notion of polynomial functor can be also defined for Meas—the category of measurable 
spaces and measurable functions between them. 

► Definition 2.2. A (standard Borel) polynomial functor F on Meas is defined by the 

following BNF notation: F ::= id | | Fi x Fa | Fi. Here / is a countable set; 

and we require that (A, 5 a) G Meas is a standard Borel space (see e.g. |^). The cr-algebra 
^FX associated to FX is defined in the obvious manner. Namely: for F = id, 5 p’x = dx', for 
F = (A, 5 a), dpx = i?a; for F = Fi xFa, 5 fx is the smallest tr-algebra that contains Ai x Aa 
for all Ai G ^FiX and Aa G ^f^x; for for F = F„ ^px = {lJ*g/ A^ | Ai G 5 f,x}- 

For arrows, F works in the same manner as a polynomial functor on Sets. 

In what follows, a standard Borel polynomial functor is often called simply a polynomial 
functor. 

The technical requirement of being standard Borel in the above will be used in the proba¬ 
bilistic setting of ^(it is also exploited in [SJIll]). A standard Borel space is a measurable 
space induced by a Polish space; for further details see e.g. [3]. 

There is a natural correspondence between polynomial functors and ranked alphabets. 
In this paper a functor F for the (linear-time) transition type is restricted to a polynomial 
one; this means that we are dealing with (T-branching) systems that generate trees over 
some ranked alphabet. We collect some standard notions and notations for such trees in 
Appendix |A.l I they will be used later in showing that our coalgebraic infinite traces indeed 
capture infinite tree languages of such systems. 

We go on to introduce monads T for branching. We principally use two monads—the 
powerset monad V on Sets and the suh-Giry monad Q on Meas. The latter is an adaptation 
of the Giry monad m and inherits most of its structure from the Giry monad; see Rem. 

► Definition 2.3 (monads V and Q). The powerset monad is the monad {V,rj^, pf’) on Sets 
such that VX = {A C X} and Vf{A) = {/(x) | x G A}. Its unit is given by the singleton 
set r]^{x) = {x} and its multiplication is given by /i^(M) = Uagm 

The suh-Giry monad is the monad {Q^rf, pP) on Meas such that 
™ G{X,^x) = (GX,Sgx), where the underling set GX is the set of all subprobability mea¬ 
sures on (A, 5x)- The latter means those measures which assign to the whole space X 
a value in the unit interval [0,1]. 

H The cr-algebra Sgx on GX is the smallest cr-algebra such that, for all S G 5x, the 
function evg : GX -G [0,1] defined by evs(F) = P{S) is measurable. 

" Gf{F){S) = F{f~^{S)) where / : (A,5x) —> (T,5x) is measurable, v G GX, and S G 5f- 
" 5x)(a:) given by the Dirac measure: jj^^(x)(S') is 1 if x G S' and 0 otherwise. 

H p^j^ jj^j('I')(S) = ev 5 d'k where 'k G G^X, S G 5x and evg is defined as above. 

A monad gives rise to a category called its Kleisli category (see e.g. [H]). 

► Definition 2.4 (Kleisli category Ki{T)). Given a monad {T,r],p) on a category C, the 
Kleisli category for T is the category K,i{T) whose objects are the same as C, and for each 
pair of objects X,Y, the homset IC£{T){X,Y) is given by C{X,TY). An arrow in IC£{T) is 
referred to as a Kleisli arrow, and depicted by A-p A for distinction. Note that it is nothing 
but an arrow A —>■ TY in the base category C. 


2.6 
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Moreover, for two sequential Kleisli arrows f \ X^Y and g -.Y^ Z, their composition 
is given by g,z o Tg o f and denoted hy g Q f. The Kleisli inclusion functor is the functor 
J : C —>■ KI{T) such that JX = X and J/ = ryy o / for / : X —>• F in C. 

It is known that a functor f : C —>■ C canonically lifts to a functor F : K£{T) —> K£{T), 
given that there exists a natural transformation A : FT ^ TF that is compatible with the 
unit and the multiplication of T. Such a natural transformation is called a distributive law. 
For more details, see [53]. 

Throughout this paper, we fix the orders on the homsets of KI{V) and IC£{Q) as follows. 

► Definition 2.5 (order enrichment of 0(7^) and IC£{Q)). We define an order on/C£(7^)(Af, F) 
by / E 5 ^ Vx e X. f{x) C g{x). We define an order on 1C£{Q){X, F) by / E 3 Va; G 
X.yA G ^Y- f{x){A) < g{x){A). Here the last < is the usual order in the unit interval [0,1]. 

► Remark 2.6. The sub-Giry monad Q is an adaptation of the Giry monad from m-, in the 
original Giry monad we only allow (proper) probability measures, i.e. measures that map the 
whole space to 1. We work with the sub-Giry monad because, without this relaxation from 
probability to subprobability, the order structure in Def. |2.5| is reduced to the equality. 


[3~\ Infinite Traces, Kleisli Simulations and Coalgebras in }C£(T) 


In this section we review the categorical constructs, the relationship among which lies at 
the heart of this paper. They are namely: coalgebraic infinite trace semantics [17] . Kleisli 
simulation [T3| [131 [5S] and forward partial execution (FPE) |5S] . 

The following situation is identified in (see also §A.2| and §A.5.3| ): the largest 
homomorphism to a certain coalgebra that we describe below is observed to coincide with 
the standard, conventionally defined notion of infinite language, for a variety of systems. 
An instance of it is shown to arise, in im, when C = Sets, T = V and F is a polynomial 
functor. In 0 we will give another proof for this fact; the new proof will serve our goal of 
showing soundness of backward simulations. 


► Definition 3.1 (infinite trace situation). Let F be an endofunctor and T be a monad on a 
category C. We assume that each homset of the Kleisli category IC£{T) carries an order E- 
A functor F and a monad T constitute an infinite trace situation with respect to E if they 
satisfy the following conditions. 

H There exists a final F-coalgebra ( : Z —>■ FZ in C. 

H There exists a distributive law A : FT ^ TF, yielding a lifting F on IC£{T) of F. 

H For each coalgebra c : A-g FX in 1C£{T), the lifting JC, : F-g FZ of f admits the largest 
homomorphism. That is, there exists a homomorphism tr°°(c) : A -G F from c to Jf 
such that, for any homomorphism / from c to Jf, f E tr°°(c) holds. 


FX 


In [m [T5J [5S] we augment a coalgebra with an explicit arrow for initial states. The 
resulting notion is called a (T, F)-system. 

► Definition 3.2 (infinite trace semantics for (T, F)-systems [161117|L 
Let C be a category with a final object 1 G C. A {T, F)-system is a 
triple X = (A, s, c) consisting of a state space A G C, a Kleisli arrow = 

s : 1-G A for initial states, and c : A-g FX for transition. 

Let us assume that the endofunctor F and the monad T on C con- F 
stitute an infinite trace situation. The coalgebraic infinite trace 
semantics of a (T, F)-system X = (A, s,c) is the Kleisli arrow i 
tr°°(c) © s : 1-G Z (see the diagram, in IC£{T), on the right). 


-JC 

■Z 
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Suppose that we are given two (T, F)-systems X = (X, s, c) and y = {Y,t,d). Let 
us say we aim to prove the inclusion between infinite trace semantics, that is, to show 
tr°°(c) © s C tr°°((i) © t with respect to the order in the homset of 0(T). Our goal in this 
paper is to offer Kleisli simulations as a sound means to do so. 

The notions of forward and backward Kleisli simulation are introduced in m as a cat¬ 
egorical generalization of fwd./bwd. simulations in [21]. They are defined as Kleisli arrows 
between (the state spaces of) two (T, F)-system that are subject to certain inequalities—in 
short they are lax/oplax coalgebra homomorphisms. In [14] they are shown to be sound with 
respect to finite trace semantics—the languages of finite words, concretely; and the unique 
arrow to a lifted initial algebra (that is a final coalgebra, see [T^ and the introduction), 
abstractly. In this paper we are interested in their relation to infinite trace semantics. 

► Definition 3.3 (fwd./bwd. Kleisli simulation [H]). Let F be an endo- 
functor and T be a monad on C such that each homset of K£{T) carries 
an order C. Let X = {X,s,c) and y = {Y,t,d) be (T, F)-systems. 

A forward Kleisli simulation from A to 3^ is a Kleisli arrow / : K -o- A 
that satisfies the following conditions (see the diagram). 

s^f&t, and c©/CF/©d. 

We write X Cp y if there exists a forward simulation from X to y. 

A backward Kleisli simulation from A to 3^ is a Kleisli arrow 6 : A -p K 
that satisfies the following conditions (see the diagram). 

6 © s © t, and Fb Q c ^ d Q f. 

We write A ©b 3^ if there exists a backward simulation from A to 3^. 

Forward partial execution (FPE) is a transformation of a (T, A)-system introduced in [25] 
for the purpose of aiding discovery of Kleisli simulations. Intuitively, it “executes” the given 
system by one step. 

► Definition 3.4 (FPE |25j). Let F be an endofunctor and T be a monad on C. Forward 
partial execution (FPE) is a transformation that takes a (T, F')-system A = (A, s, c) as an 
input and returns a (T, F)-system AppE = (EA, c © s, Fc) as an output. 

It is shown in [23] that FPE is a valid technique for establishing inclusion of finite trace 
semantics, in the technical senses of soundness and adequacy. Soundness asserts that discov¬ 
ery of a Kleisli simulation after applying FPE indeed witnesses trace inclusion between the 
original systems; adequacy asserts that if there is a Kleisli simulation between the original 
systems, then there is too between the transformed systems. In this paper, naturally, we 
wish to establish the same results for infinite trace semantics. 

Systems with Nondeterministic Branching 

In the rest of the paper we develop a coalgebraic theory of infinite traces and (Kleisli) 
simulations—the main contribution of the paper. We do so separately for the nondetermin¬ 
istic setting (T = V) and for the probabilistic one (T = G). This is because of the difference 
in the constructions of infinite traces, and consequently in the soundness proofs. 

In this section we focus on the nondeterministic setting; we assume that E is a polynomial 
functor. 







N. Urabe and I. Hasuo 


7 


4.1 Construction of Infinite Traces 


The following is already known from HZ]. 


► Theorem 4.1. The combination of polynomial F and T = V constitute an infinite trace 

situation (Def. ^3^. ◄ 

The proof in m combines fibrational intuitions with some constructions that are specific 
to Sets. Here we present a different proof. It exploits an order-theoretic structure of the 
Kleisli category ]C£{V); this will be useful later in showing soundness of (restricted) backward 
simulations. Our proof also paves the way to the probabilistic case in ^ 

In fact, our proof of Thm. jTTj is stated axiomatically, in the form of the following propo¬ 
sition. This is potentially useful in identifying new examples other than the combination of 
polynomial F and T = V (although we have not yet managed to do so). It is essentially the 
construction of a greatest fixed point by transfinite induction [S] . 

► Proposition 4.2.1 C &e a category, F be an endofunctor on C, and T be a monad on 
C. Assume the following conditions. 

1. There exists a final F-coalgebra f : Z ^ FZ in C. 

2. There exists a distributive law A : FT ^ TF, yielding a lifting F on IC£(T) of F. 

3. For each X,Y G K,i{T), the homset 1C£{T){X,Y) carries a partial order C. Moreover, 
F’s action on arrows, as well as composition of arrows in K,t{T), is monotone with 
respect to this order. 

4. For each X,Y G KJt{T), every (possibly transfinite) decreasing sequence in IC£(T){X,Y) 
has the greatest lower bound. That is: let a be a limit ordinal and {gi : X-G T)i<a be a 
family of arrows such that i < j implies 3 <?j- Then flKaffi exists. 

5. For each AT G C, the homset KI{T){X,Z) has the largest element Tx,z- 
Then T and F constitute an infinite trace situation with respect to C. 


— i^T X z — 

FX - 


a: 


-H- >Z 


► Proof. Let c : X -G FX be an F-coalgebra in IC£{T). We shall construct the largest 
homomorphism tr°“(c) : X-G Z from c to J(, by transfinite induction. 

We define an endofunction ■ JC£{T){X, Z) -G 1C£{T){X, Z) by 
^x{f) = Q F f Q c. By the monotonicity of © and F (As¬ 

sumption 1^, <i>x is also monotone. For each ordinal a, we define 
^xC^x,z) G IC£{T){X, Z) by the following transfinite induction. 

“ ^x0~x,z) = x,z- 
H For a successor ordinal a, <i)^(Tx ,z) = x,z))- 

. For a limit ordinal a, 4'x(Tx,z) = r\,<a^xV^x,z)- (cf. Assumption!^ 

We define I to be the smallest ordinal such that the cardinality of [ is greater than that of 
JC£{T){X, Z). Then from [S], ^x(Tx,z) is the greatest fixed point of 4)x. This immediately 
implies that ^x(Tx,z) is the largest homomorphism from c to Jf. ◄ 

Note that the local continuity of composition in IC£{T) is not assumed. This is because 
V —our choice for T in this section—does not satisfy it. Indeed, consider f : X -G Y and 
a decreasing sequence {gi : Y -G Z)i^i.„, both in K.£{V). Then we have (FIzgcj ^0 © f{x) = 
Uyefix) riiGc. 9iiy) while [\^gi © f){x) = Hie,, UyG/(x) 9^{y), and these two are not equal 


in general (e.g. Example A.31I. This failure of continuity prevents us from applying the 
(simpler) Kleene fixed-point theorem, in which induction terminates after w steps. There 
does exist a nondeterministic automaton for which the largest homomorphism is obtained 
after steps bigger than w; see Example |A.31[ 

It is easy to check that all the assumptions in Prop. jT^ are satisfied by polynomial F and 
T = V. This yields Thm. |TT| We can also show that the resulting coalgebraic infinite trace 
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semantics coincides with the usual definition of (infinite) tree languages for nondeterministic 
systems. See §A.2.1|for details. 


4.2 Kleisli Simulations for Nondeterministic Systems 
4.2.1 Forward Simulations 


Soundness of forward simulation is not hard; we do not have to go into the construction in 


Prop. 4.2 


► Theorem 4.3. Given two {V, F)-systems X = (A, s, c) and y = {Y, t, d), X Cp y implies 
tr°°(c) © s C tr°°((i) © t. ◄ 


The proof, again, is formulated as a general result, singling out some sufficient axioms. 

► Lemma 4.4.1 p ^g endofunctor and T he a monad on C; assume further that 
they constitute an infinite trace situation (with respect to G). We assume the following 
conditions. 

1. Each homset of ICi{T) is uj-complete, that is, each increasing co-sequence in it has the 
lub. 

2. Composition © of arrows in K£{T) and F’s action on arrows are both co-continuous 
(i.e. they preserve the lub. of an increasing co-sequence). It follows that they are both 
monotone. 

For two (T, F)-systems X = {X, s, c) and y = (Y, t,d), if f -.Y^ X is a forward simulation 
from T to y, then tr°°(c) © / E tr°°{d). As a consequence we have tr°°(c) © s © tr°°(d) ©t. 

► Proof. Let C : Z —)■ FZ be a final Y-coalgebra in C. We define a function 4)^ : 

IC£{T){Y, Z) —>• KI{T){Y, Z) by 4)y (g) = © Fg © d; note that C is a final coalgebra and 

hence an isomorphism. Then 

tr°“(c) © / = © F(tr°“(c)) d) cQ f (tr°“(c) is a homomorphism) 

© 4)y(tr°°(c) © /) (/ is a fwd. sim., and the definition of 4)y). 


F(tr“{d)) 


FY 


By the assumption that F and the composition are 
monotone, 4>y is also monotone. Therefore by repeatedly 
applying 4>y to the both sides of the above inequality, we 
obtain an increasing sequence tr°°(c) © / © 4)y(tr°°(c) © 

/) © 4>2,(tr“(c) ©/)©••• in 0(T)(F, Z). 

As lCi{T){Y,Z) is w-complete, the least upper bound 
4>*(tr°°(c) ©/) exists. By the assumption that F and 
© are both locally w-continuous, 4)y is also w-continuous. 

Therefore (c) © /) is a fixed point of 4>y, and hence a homomorphism from 

d to Jf. As tr“(d) is the largest homomorphism from d to J((, this implies tr°°(c) © 
/ E r°°(c) © /) © tr°“(d). Combining with the assumption that / is a forward 

simulation (its condition on initial states), we have tr“(c)©s © tr°°(c)©/©t © tr°°{d)Qt. ◄ 



It is known from m that the combination of polynomial F and T = V satisfy the 
conditions of Lem. |4.4| Hence we obtain Thm. |4.3| i.e. soundness of fwd. simulation in the 
nondeterministic setting. 
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4.2.2 Backward Simulations 


Next we wish to establish soundness of backward Kleisli simulations with respect to infinite 
traces (for finite traces it is shown in [HI). In fact, the desired soundness fails in general—a 
counterexample is in Example A.32 It turns out that we can impose certain restrictions on 
backward Kleisli simulations and ensure soundness. 


► Definition 4.5 (totality, image-finiteness, TIF-backward simulation). Let X = (A, s, c) and 
y = {Y,t,d) be (7^, E')-systems. A backward simulation b : XY from A to 3^ is total if 
b{x) yf 0 for all x G A; it is image-finite if b{x) is finite for all x € X. If b satisfies both 
of the two conditions, it is called a TIF-backward simulation. We write X y if there 
exists a TIF-backward simulation from A to 3^. 


► Theorem 4.6 (soundness of Eb^^). For two {V, F)-systems A = (A, s, c) and y = (A, t, d), 

X E™ y implies tr°°(c) © s E tr“((i) © t. ◄ 

The proof of Thm. |4.6| is, yet again, via the following axiomatic development. 

► Definition 4.7 (TIF-backward simulation, generally).! L 0 I; p endofunctor and T be 

a monad on C that satisfy the conditions in Prop. |4.2| wrt. E. For two (T, F)-systems 
A = (A, s, c) and y = (Y,t,d), a TIF-backward simulation from A to 3^ is a backward 
simulation & : A-p A that satisfies the following conditions. 

1. The arrow 6 : A-p A satisfies T y.z Q b = Tx,z- 

2. Precomposing 6 : A-p A preserves the greatest lower bound of any decreasing transfinite 
sequence. That is, let A G KI{T), a be a limit ordinal, and (gi : A-p A)i<o be a family of 
Kleisli arrows such that i < j implies gi □ 5j. Then we have niGa(5i Ob) = (fliga 9i) © b. 

We write A Eb^^ y if there exists a TIF-backward simulation from A to y. 


Assumption of Def. |4.7| resembles how “finiteness” is formulated in category theory, 
e.g. in the definition of finitary objects. 

This general TIF-backward simulation satisfies soundness. For its proof we have to look 
into the inductive construction of the largest homomorphism in §4.1[ 


For two {T, F)-systems X = (A, s,c) and 
implies tr°° (c) O tr°° (d) Qb. Furthermore 

it follows that tr°“(c) © s E tr°°((i) © t. 


► Lemma 4.8.! Let F and T be as in Prop. 4-2 
y = {Y,t,d), X Eb^^ y (in the sense of Def. 4-''/ 


: Z —)■ FZ he a final F-coalgebra in C. 
: 0(T)(A,Z) ^ U{T){X,Z) and 4>v : 
IC£{T){Y, Z) as in the proof of Prop. 


FT^ 


4.2 


FA 


► Proof. Let ( 

We define 4)x 
ia{T){Y,Z) 

Moreover, in the same manner as in the proof of Prop. EH 
for each ordinal a, we define x.z) : A -G A and 

‘h^(Tv,z) : A -G Z by the transfinite induction on a. As 
we have seen in the proof of Prop. |4.2[ there exist ordinals 
lx and Iy s.t. tr“(c) = $'^(Tx.z) and tr“(d) = $^(Tv,z). 

Let [ = max(Ijf, (y). We shall now prove by transfinite induction that, for each o, we have 
x,z) E ‘hy (T Y,z) © b] this will yield our goal by taking a = [. 

For a = 0, from Assumption of Def. 4.7 we have 







4>y(T Y,z) © b. 

Assume that a is a successor ordinal and 4)^^( 




)E4>“ 


x,z) = T= T Y,z Q b = 
Y,z) © b. Then 


— 1 
Y 


^xYx.z) E JC^ © F{^^-\Ty,z)) OFbOc 
E^y(Ty,z)©& 


(by induction hypothesis) 
(b is a bwd. simulation). 
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Let a be a limit ordinal and assume that d)^(T x,z) ^ y^z) © b for all i < a. Then 

‘i>^(Tx.z)Eni<c.(‘J>V (T Y^z) © b) (by induction hypothesis) 

= d)5'(T Y^z) © b (by Assumptionof Def. |4.7D . 

Thus tr°°(c) © tr°“((i) © b. The last claim follows from b’s condition on initial states. ◄ 


Proof of Thm. 4.6 In Lem. |A.r7|we prove that a TIF-backward simulation in the specific 


sense of Def. |4.5| is also a TIF-backward simulation in the general sense of Def. |4.7[ Therefore 
Lem. [T8| yields trace inclusion. ◄ 


Even with the additional constraints of totality and image-finiteness, backward Kleisli 
simulations are a viable method for establishing infinite trace inclusion. An example is in 
Example |A.33| where a fwd. simulation does not exist but a TIF-bwd. simulation does. 


4.3 Forward Partial Execution for Nondeterministic Systems 

We now apply forward partial execution (FPE) |25] — a transformation of coalgebraic systems 
that potentially increases the likelihood of existence of simulations—in the current setting 
of nondeterminism and infinite traces. We follow the setting in m for the finite traces, and 
formulate FPE’s “correctness” in the following theorem. 


► Theorem 4.9. Let F be a polynomial functor on Sets. For (V, F)-systems X = (A, s, c) 
and y = (Y, f, d), the following hold. 

1. a. (soundness of FPE for fwd. sim.) Afpe ©f y implies tr°°(c) © s © tr'^(d) © t. 
b. (adequacy of FPE for fwd. sim.) X ©p y implies Afpe ©f 3^- 

2. a. (soundness of FPE for bwd. sim.) X ©^^^ J^fpe implies tr°°(c) © s © tr“(d) © t. 

b. (adequacy of EPE for bwd. sim.) X ©g^^ y implies X ©^^^ J^fpe, assuming that the 
following hold, 
i. d{y) yf 0 for all y GY. 

a. d(y) is finite for all y G Y. ◄ 

Informally: soundness means that discovery after applying FPE still witnesses the trace 
inclusion between the original systems; and adequacy means that the relationship ©f (or 
© 3 ^^) is not destroyed by application of FPE. The theorem also implies that FPE must 
be applied to the “correct side” of the desired trace inclusion: X in the search for a fwd. 
simulation; and y in the search for a bwd. one. 

Note that the adequacy property is independent from the choice of trace semantics (finite 


or infinite). Therefore the statement lb of Thm. 4.9 is the same as its counterpart in 


For the statement 2b however, we have to check that the TIF restriction (that is absent 
in [^) is indeed carried over. 

In [53] it is shown that FPE can indeed create a simulation that does not exist between 
the original systems. Its practical use is witnessed by experimental results in m. too. It 
would not be hard to observe the same in the current setting for infinite traces. 


For the proof of Thm. 4.9 once again, we turn to an axiomatic development. 


► Theorem 4.10 (FPE and fwd. sim.).f Let F be an endofunctor and T be a monad on C, as 


in Lem. 4-4 (that is, they constitute an infinite trace situation and satisfy the two additional 
assumptions.) Let X = (A, s,c) and y = (Y,t,d) be {T,F)-systems. Then we have: 

1. (soundness for fwd. sim.) Afpe ©f y implies tr'^(c) © s © tr°°(d) © t. 

2. (adequacy for fwd. sim.) X ©f y implies Afpe ©f 3^- 


•4 
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► Theorem 4.11 (FPE and bwd. sim.).^ Let F be an endofunctor and T be a monad on C 
that satisfy the eonditions in Prop. \4-^ (hence those in Lem. 4-8). Let X = {X,s,c) and 
y = {Y,t,d) be {T, F)-systems. 

1 V |—TIF 

2. 


(soundness for bwd. sim.) X Cg 
(adequacy for bwd. sim.) X y implies X Cg 


J^fpe implies tr°“(c) © s C tr°°(d) © t. 

-TIF if ifig following conditions are 

satisfied. 

a. The coalgebra d -.Y^ FY satisfies T -py z ® ^ ~ ~^y,z ■ 

b. Precomposing d preserves the gib. of a decreasing transfinite sequence. ◄ 


► Proof of Thm. |4^ [^is immediate from Thm. |4.10[ In a similar manner to Lem. |A.17| we 
can prove using Thm. |4.11[ ◄ 


[~^ Systems with Probabilistic Branching 


We now turn to probabilistic systems. They are modeled as (0, F)-systems in the category 
Meas. Here we establish largely the same statements as in ^ but many constructions 
and proofs are different. Throughout this section F is assumed to be a (standard Borel) 


polynomial functor on Meas (Def. 2.21. 


5.1 Construction of Infinite Traces 

► Theorem 5.1. The combination of polynomial F and T = Q constitute an infinite trace 
situation (Def. \3. T). 


Our basic idea of the construction is similar to that for V (f 4.11. Our goal is to construct 
the largest homomorphism from an F-coalgebra c in to the lifted final coalgebra Jf : Z -e>- 
FZ; we do so inductively, starting from the top element and going down along a decreasing 
sequence. Compared to the nondeterministic case (T = V), major differences are as follows. 
K Composition of Kleisli arrows is a;°P-continuous in IC£{Q). This is an advantage, because 
we can appeal to the Kleene fixed point theorem and we only need inductive construction 
up-to uj steps (while, for V, we needed transfinite induction). 

H A big disadvantage, however, is the absence of the top element T x,z in K£{T){X, Z). 
One can imagine a top element Yx,z to assign 1 to every event—this is however not a 
(probability) measure. 

To cope with the latter challenge, we turn to 
the final F-sequence in Meas that yields a final F- 
coalgebra as its limit. Instead of using a sequence like 
T □ 4)(T) □ • • • in IC£{T){X, Z) (where the largest el¬ 
ement T does not exist anyway), we use a decreasing 
sequence that goes along the final sequence. 

The precise construction is found in the proof of the following proposition (the proof is 



in Appendix A.4). 


► Proposition 5.2.^ Let C be a category, F be an endofunctor on C, and T be a monad on 
C where each homset of KJt{T) carries an order ©. We assume the following conditions. 

1. The category C has a final object 1; the final sequence 1 '4^ FI F'^1 ... hag 

a limit {Z,(^i : Z —> J^*l)ig(^); and moreover, F preserves this limit. (Hence the limit 
carries a final F-coalgebra m-) 

2. There exists a distributive law A : FT © TF, yielding a lifting F on IC£(T) of F. 
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3. For X,Y G ]C£{T), every decreasing co-sequence /o 3 /i 3 • ■ • in lCi{T){X,Y) has the 

greatest lower hound Moreover, composition of arrows in X£{T) and F’s action 

on arrows are both co°p- continuous. That is, for each g : Z-G X and h :Y-g W, we have 
gQiUieufi) = = andF{\^i^^fi) = 

4. The lifting J(!x) of the unique arrow to 1 is the largest element of X£{T){X,1). 

5 . The functor J lifts the limit in Assumption^to a 2-limit. Namely, for any cone {X, (tt^ : 

X-G over the sequence 1 FI F^l •••, there uniquely exists 

I : X -G Z s.t. TTi = Jji © I holds for each i G cj. Moreover, if I' : X -G Z satisfies 
Jli Ql' Q J"fi 0 I for each i G co, then I' © I holds. 

Then F and T constitute an infinite trace situation with respect to Q. ◄ 


In more elementary terms, Assumption asserts that: J lifts the limit Z; and the lifted 
limit satisfies a stronger condition of “carrying over” the order between cones to the order 
between mediating maps. 

► Proof of Thm. [0] We have to check that polynomial F and T = Q satisfy the assumptions 
in Prop. [5?^ The most nontrivial is Assumption]^ there we rely on Kolmogorov’s consistency 
theorem, for the fact that a limit is lifted to a limit. That the latter is indeed a 2-limit is 
not hard, exploiting suitable monotonicity. Details are found in Lem. |A.18| ◄ 


We can also show that the resulting coalgebraic infinite trace semantics coincides with 
the usual definition of (infinite) tree languages for probabilistic systems. See ^A.2.2 for 
details. 


5.2 Kleisli Simulations for Probabilistic Systems 
5.2.1 Forward Simulations 

Soundness of forward simulation, in the current probabilistic setting, follows immediately 
from the the axiomatic development in Lem. |4.4| 

► Theorem 5.3. Given two {Q, F)-systems X = (A, s, c) and y = {Y,t,d), X Cp y implies 
tf°°{c)QsQtr°°{d)Qt. ◄ 


5.2.2 Backward Simulations 


Next we turn to backward simulations. Similarly to nondeterministic setting ( ^4.2.2 1, we 
have to impose a certain restriction on backward Kleisli simulations to ensure soundness. By 
the feature of Q that composition in X£{Q) is w-continuous, the image-finiteness condition 
is no longer needed. 

► Definition 5.4 (totality, T-backward simulation). Let X = (A, s,c) and y = {Y,t,d) be 
{Q, F)-systems. A backward simulation b : X-gY from A to 3^ is total if h{x){Y) = 1 for all 
X G X. If 6 is total, it is called a T-backward simulation. We write X Cg y if there exists a 
T-backward simulation from X to y. 

► Theorem 5.5 (soundness of Eb)- {Q,F)-systems X = (A, s,c) and y = {Y,t,d), 

T Eb y implies tr'’“(c) © s E tr°°{d) Qt. ◄ 

The proof of Thm. |5.5| is via the following axiomatic development. 

► Definition 5.6 (T-backward simulation, generally).! Let p Le an endofunctor and T be 


a monad on C that satisfy the conditions in Prop. 5.2 wrt. E- For two (F, F)-systems 
X = (A, s,c) and y = (Y,t,d), a T-backward simulation from A to 3^ is a backward 
simulation b : X-gY that satisfies the following condition: 
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1. The arrow b : X-¥>-Y satisfies Jly Qb = Jlx- Here !y: —>■ 1 is the unique function. 

We write X Cg y if there exists a T-backward simulation from X to y. 


This general T-backward simulation satisfies soundness. For its proof we have to look 
into the inductive construction of the largest homomorphism in ^5.1| (Prop. |5.2[). 


► Lemma 5.7.^^ Let F and T be as in Prop. 5.2 For two {T,F)-systems X = (X,s,c) and 
y = (Y,t,d), X Cg y (in the sense of Def. 5.6) implies tr°“(c) C tr°^{d) 0 b. Furthermore 
it follows that tr°“(c) © s C tr°°{d) Qt. ◄ 


Proof of Thm. 5.5 In Lem. |A.19| we prove that a T-backward simulation in the specific 


sense of Def. |5.4| is also a T-backward simulation in the general sense of Def. 5A Therefore 
Lem. |5.7| yields trace inclusion. ◄ 


5.3 Forward Partial Execution for Probabilistic Systems 

We show that FPE can be used to aid discovery of forward and backward simulations, also 
in the current probabilistic setting. 


► Theorem 5.8. Let F be a polynomial functor on Meas. For {Q,F)-systems X = (X,s,c) 
and y = (Y,t,d), the following hold. 

1. a. (soundness of FPE for fwd. sim.) Xfp£ Cp y implies tr°°(c) © s © tr°°((i) © t. 
b. (adequacy of FPE for fwd. sim.) X Cp y implies Tfpe Ef 3^- 

2. a. (soundness of EPE for bwd. sim.) X Eb ^Vfpe implies tr°°(c) © s E tr°°(d) © t. 

b . (adequacy of EPE for bwd. sim.) X Eb 3^ implies X Eb 3^fpe, assuming that: 
d{y){FY) = 1 for all y &Y. 


The item for forward simulations follows immediately from Thm. |4.10| For the rela¬ 
tionship to backward simulations, we develop another general result. 


► Theorem 5.9 (FPE and bwd. 


sim.).l Let F be an endofunctor and T be a monad on C 
that satisfy the conditions in Prop. (hence those in Lem. 5.7). Let X = (X, s,c) and 
y = {Y,t,d) be {(F,F)-systems. 

1 . (soundness for bwd. sim.) X Eb 3^fpe implies tr°°(c) © s E tr'^((i) © t. 

2 . (adequacy for bwd. sim.) X Eb 3^ implies X Eb 3^fpE) assuming that: the coalgebra 


d : F-p FY satisfies J\py <3 d = Jly. 


► Proof of Thm. 15.81 The item [T] is immediate from Thm. 14.101 In a similar manner to 
Lem. |A.19[ we can prove the item using Thm. |5.9| ◄ 


6 Systems with Other Branching Types 


In this section we briefly discuss two more pairs of F and T that constitute infinite trace 
situations. 

The first pair is a polynomial functor F on Sets and the lift monad C. For a given set 
X G Sets, CX is given by {T} -F X. The added element T represents the aborting or non¬ 
termination of the program, and hence an (£, F')-system can be regarded as a tree automaton 
with exception. To show that F and £ constitute an infinite trace situation, we rely on 


Prop. 5.2 (but not Prop. 4.2 since LX does not have the greatest element). Therefore, 
much like for Q, we can check trace inclusion by forward or T-backward simulations (see 


(5.2). More details are found in (A.5 
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The second pair is that of polynomial F on Sets and the subdistribution monad T>. 
For a given set X G Sets, VX is the set {d: X ^ [0,1] | (discrete) 

subdistributions over X. The subdistribution monad T> is similar to the sub-Giry monad Q, 
and a {V, F)-system can be also regarded as a probabilistic tree automaton. We can prove 
that F and T> constitute an infinite trace situation. The resulting infinite trace semantics 
has limited use, however, due to the discrete nature of an arrow X -p FZ (it assigns a 
probability to a single tree and the probability is most of the time 0; see Example O- 
Another difficulty is that infinite traces for T = does not follow from either of our general 


results (Prop. 4.2 or Prop. 5.21—in 5 A.6 we construct infinite traces for T = in concrete 


terms. This prevents us from applying the general theories for Kleisli simulations in iH 
For more details, see 


[Y] Related Work 


The construction of the largest homomorphism given in Prop. 5.2 is based on the one in [5]. 
The latter imposes some technical conditions on a monad T, including a “totality” condition 
that excludes T = V from its instances (the nonempty powerset monad is an instance). Our 
assumption of lifting to a 2-limit (Assumption in Prop. 5.21 is inspired by a condition 
in [B], namely that the limit Z is lifted to a weak limit in 1C£(T). It is not the case that 


Prop. 5.2 subsumes the construction in [B]: the former does not apply to the nonempty 


powerset monad (but our Prop. 4.2 does apply to it). 

In |I9j . an explicit description of a (proper, not weakly) final E-coalgebra is given for 
F G { S X (_), 1 -I- S X (_) } and T G {G,G=i}- Here G=i is the Giry monad and re¬ 
stricts G to proper, not sub-, distributions. We do not use their results (proper finality) 
for characterization of infinite traces, because: 1) if T = ^ then the final coalgebras do not 
coincide with the set of possibly infinite words; and 2) if T = G=i then language inclusion is 
reduced to the equality. We doubt about the value of developing simulation-based methods 
for the latter degenerate case, one reason being that trace inclusion is often a more difficult 
problem than trace equivalence. For example, finite trace inclusion for probabilistic systems 
is undecidable [3] while trace equivalence is decidable m- 

In [21], it is shown that: a limit of a w°P-sequence consisting of standard Borel spaces 
and surjective measurable functions is preserved by a polynomial functor F (where constants 
are restricted to standard Borel spaces), and also hy G- It is also shown there that such a 
polynomial functor F preserves standard Borel spaces, and so does G- These facts imply the 
existence of a final t/F-coalgebra in Meas for every polynomial functor F. Note however 
that this final ^F-coalgebra captures (probabilistic) bisimilarity, not trace semantics. 
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Conclusions and Future Work 


We have shown that the technique forward and backward Kleisli simulations na and that 
of FPE [25] —techniques originally developed for witnessing finite trace inclusion—are also 
applicable to infinite trace semantics. We followed [TT] (and also [BUS]) to characterize 
infinite trace semantics in coalgebraic terms, on which we established properties of Kleisli 
simulations such as soundness. We developed our theory for two classes of instances: non- 
deterministic systems and probabilistic ones. 

There are some directions for a future work. In m, in addition to FPE, a transformation 
called backward partial execution (BPE) is introduced. Similarly to FPE, BPE can also aid 
forward and backward Kleisli simulation for finite trace in the sense that it satisfy soundness 
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and adequacy. However, BPE is only defined for word automata (with T-branching) and 
not generally for (T, F)-systems. Defining BPE categorically and proving its soundness and 
adequacy with respect to infinite trace, possibly restricting to word automata, is one of the 
future work. 

Another direction is implementation and experiments. As forward and backward Kleisli 
simulations in this paper are defined in almost the same way as we can use the imple¬ 
mentation already developed there to check infinite trace inclusion. 

Acknowledgments The authors are supported by Grants-in-Aid No. 24680001 & 15K11984, 
JSPS. 
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I A I Appendix 

A.l Ranked Alphabet and Infinite Trees 

All the systems that we will be using in this paper are those which generate trees. Here 
we collect some standard notions and notations on (the conventional presentation of) such 
finite/infinite trees. 

The generated trees are labeled with letters from an alphabet. 

► Definition A.l. A ranked alphabet is a family S = of sets. A standard Borel 

ranked alphabet is a family S = ((S„, Sn))^^^ of standard Borel spaces. The index n € tu is 
called an arity. 

For the definition of infinite trees, we follow [7]. Each node labeled with a letter of arity 
n has n children. The idea of A:-prefix trees is introduced in m- It can be regarded as a 
finite tree of depth k that is obtained by extracting nodes of an infinite tree. 

► Definition A.2. Let S = be a ranked alphabet. A Y,-labeled infinite tree is a pair 

(D, 1) of the domain D G N* and the labelling function I : D ^ UraGi.ij such that: 

H the domain D is prefix-closed (i.e. Va G N*.Vf gN. ai G D => a G D), nonempty, and 
downward-closed (i.e. Va G N*. Vf G N. G D Vj < i. aj G D), and 

H moreover, for each a G D and f G N such that l{a) G S„, ai G D iS 0 < i < n — 1. 

For fc G w, a H-labeled k-prefix tree is a pair (D, 1) of the domain D and the labelling function 
I : D -G UriGixi that satisfy the following conditions. If A: = 0, then D is an empty set 
while if A: > 0, then D C and it is prefix-closed, nonempty, and downward-closed. 

Moreover, for a G I? and z G N such that |a| < k and l{a) G E„, az G I? iff 0 < z < n — 1. 

Here, k is called the depth of {D,l). We write Treeoo(E) and Tree^(S) for the sets of all 

S-labeled infinite trees and S-labeled A:-prefix trees, respectively. 

A S-labeled A:-prefix tree t = {D, 1) is said to be a prefix of a S-labeled infinite (or 
A:'-prefix for some k' > k) tree t'{D',I') and denoted hy t < t' ii D G1 D' and for each 
a G D, 1(a) = h(a). For a S-labeled infinite A:-prefix tree A, a cylinder ouer t is the set 
cyl(A) = {f G Treeoo(S) \t^t'}. 

For a S-labeled infinite tree t = (D, 1) and a G D, a ’th subtree of t is a S-labeled infinite 
tree t^ = (Da,la) where Da = {/3 G N* | aj3 G Dj and la(/3) = l(a/3). 

For a G S„ and S-labeled infinite trees tg = (Dg, Ig),... ,Ara-i = (Dn-i, In-i), we write 
(a,tg,..., tn-i) for a S-labeled infinite tree t = (D, 1) where D = {iai |0<z<n — l,aiG 
Di} and l(ia) = li(a) for each z G {0,..., rz — 1}. 

Later, we will use an infinite tree automaton —an automaton that generate S-labeled trees. 
When So = {/}, and S^ = 0 for all z > 2, an infinite tree automaton can be regarded as 
an automaton that generates words instead of trees. We call such an automaton infinite 
automaton (suppressing the word “tree”). 

A system that generates S-labeled infinite trees can be represented as an F-coalgebra on 
the Kleisli category of some monad, where F is the polynomial functor defined as follows. 

► Definition A.3. For a ranked alphabet S = (S„)„g,^, we define Fs : Sets —> Sets by 

Sn X (_) ”. For a standard Borel ranked alphabet ^ = ((S„,we define 
Fh : Meas ^ Meas by F^ = lJ„g,^(S„, 5^„) x (_)". 
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A.2 Coincidence between Coalgebraic Infinite Trace Semantics and 
Automata-tbeoretic Semantics 

A.2.1 Nondeterministic Tree Automaton 


In this section, we regard a {V, F^)-system as an automaton that nondeterministically gen¬ 
erate an infinite tree. Then we show that its automata-theoretic semantics coincides with 
coalgebraic infinite trace semantics. 

► Definition A.4. Let S be a ranked alphabet. A (7^, Fs)-system X = (A, s, c) is called 
a Yi-labeled nondeterministic tree automaton. For a S-labeled infinite tree t = {D,l) and a 
state X G X, a. (A)„g,^-labeled infinite tree tr = {D, Ir) that has the same domain as t is 
called a run of X from x that generates t if 

H lr{s) = X, and 

H for each a G D such that l{a) = a G Sn, lr{a) = y and lr{ai) = yi for each 0 < i < n — 1, 
we have (a, yo, • ■ •, yn-i) € c{y). 

For a state a; € A, an infinite language of X from a; is a set L{X,x) C Treeoo(S) that 
is defined by L{X,x) = {t € Treeoo(S) | 3 run of X from x that generates t}. An infinite 
language of X is a set L{X) C Treeoo(S) that is defined by L{X) = U£cgs(*) L{X,x). 

Then we can show that the the automata-theoretic semantics of S-labeled nondeterministic 
tree automaton coincides with coalgebraic infinite trace semantics. 

► Theorem A.5. Let be a ranked alphabet. The carrier of the final F^-coalgebra is 
isomorphic to 7reeoo(S) and for a Yi-labeled nondeterministic tree automaton X = (A, s,c), 
we have tr°°(c)(a:) = L{X,x) for all x G X. Moreover, tr°°(c) © s(*) = L{X). 

► Proof. We define an arrow C, : Treeoo(S) —> F"ETreeoo(S) in Sets by C,{f) = (a, (to, • • ■, tn-i))- 
where t = {D, 1), a = l{e) G S„, and ti is the i’th subtree of t. Then it is easy to see that C 
is a final i^E-coalgebra. 

We show that L{X,_) : X-G Treeoo(S) is the largest homomorphism from c to Jf. 

We first show that L{X,_) is a homomorphism. For x G X, 


{F^L{X,_))Qc{x) 

= (FsL(A',_)) ( |(a,xo,...,Xn-i) 


Tl ^ iJ^ Qj G ) ^n — 1 ^ 

(a,xo,. -. ,Xn-l) € c{x) 


— (^7 • ■ • ) —l) 

= JC |^|(73,0eTreeoo(S) 

{{ 

= JC <^(73,0 G Treeoo(S) 

u 


n G uj, a G S„, 

3xo, . . . , Xn—l G X. 


{a,Xo,.. .^Xn-l) G c{x), 
ti G L{X,Xi) for each i 


n G UJ, l{e) G S„, 
3^0, . . . , Xn—l G X. 


{1(e), Xo, .. ■,Xn-l) G c{x), 
l{i) G L{X,Xi) for each i 

n G UJ, l{s) G Tiji, 

{1(e), Xo, . . .,Xn-l) G c{x), 
3x0, ■ • ■ ,Xn-i G X. I 3run tr^i of X from Xi that 

generates ti for each i 


= JC{{t G Treeoo(S) | there exists a run tr of X from x that generates t}) 
= JCQL{X,_){x). 


\ 

/ 


Therefore L{X, _) is a homomorphism from c to Jf. 
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It remains to prove that L{X^ ) is the largest homomorphism. Let 5 : X-p Treeoo(S) 
be a homomorphism from c to JC,. Assume that t = {D,l) G g(x) for x G X. We show 
that t G L{X, x). To prove this, it suffices to construct a run tr = {D, A) of X from x that 
generates t. For a G D, we denote for the a’th subtree of t. For each a G D, we define a 
state lr{a) G X such that G g{lr{a)) by the induction on the length of a as follows. 

For a = e, we define it by lr{e) = x. Then ta = t G g(x) = g{lr{e)). 

Assume that 1(a) G Sn and ta G g(lr(a)). As g is a homomorphism from c to J((, 
ta G g(lr(a)) = JC,~^ Q Fg Q c(lr(a)). Therefore there exists XQ,...,Xn-i such that 
(l(a),xo,... ,Xn-i) G c(lr(a)) and tai G g(xi) for each i G {0, ...,n— 1}. We define 
Ir(ai) by lr(ai) = Xi. Then tai G Ir(ai)- 

By the axiom of dependent choice, this Ir is well-defined. Moreover by its construction, 
(D, Ir) is a run of X from x that generates t. Therefore t G L(X, x) for each x G X and we 
have g C L(X 

Hence tr°°(c) = L(X,_). This immediately implies that tr°“(c) © s(*) = L(X). ◄ 

A.2.2 Coalgebraic Infinite Trace Semantics and Automata-theoretic 

Semantics of Probabilistic Tree Automata 

We give an automata-theoretic characterization of the coalgebraic infinite trace semantics 
of (5, iA:)-systems using the notion of branching process |ld] —a kind of Markov process. A 
(^, iA)-system can be regarded as a probabilistic automaton that generates trees. 

In this section, for simplicity, we assume that the ranked alphabet is a family of countable 
sets S equipped with a discrete a-algebras. However, it is not difficult to generalize the 
results in this section for automata labeled with general standard Borel ranked alphabet. 
Moreover, we also assume that the state space is finite because the result in in about 
branching processes that we will be using to show the coincidence between the automata- 
theoretic language and the coalgebraic infinite trace semantics require the restriction. 

► Definition A. 6 . For a ranked alphabet E = where E„ is countable for each 

n G to, a Yi-labeled probabilistic tree automaton is a (^, Fs)-system X = (X, s,c) s.t. Fs : 
Meas —>• Meas is defined by Fs = F^ where S = ((E„,and X is a finite set. 

To define the language of a S-labeled probabilistic tree automaton, we need some prepa¬ 
rations. For a given S-labeled probabilistic tree automaton X = (X, s, c) and a state x G X, 
we will be defining the infinite language of X from x as a probability measure L(X, x) on a 
set Treeoo(S) of infinite trees. To this end, we first have to fix a a-algebra on Treeoo(S). 

► Definition A. 7. For a ranked alphabet E, a cylinder set Ss C F(Treeoo(S)) over E is 
defined by Sy: = {cyl(t) \ k G LO,t G Tree^(E)}. A cr-algebra Uoo on Treeoo(S) is the smallest 
CT-algebra that contains Sy- 

Next, we have to define a value L(X,x)(A) for each measurable sets A G S'oo. By 
Kolmogorov’s consistency theorem (see [TB] for example), it suffices to define L(X,x) only 
for each cylinder in Sy in a “compatible” manner. We start with defining L(X,x) for 
Treeoo(E) G Sy- Intuitively, the value F(A’,x)(Treeoo(S)) is a probability where the au¬ 
tomaton does not abort. We characterize this value using the notion of branching processes. 

► Definition A. 8 . A branching process is a triple A = (r,T) consisting of a finite set F of 

types, and a transition function r : F x F* —>■ [0,1] such that X]aGr*(^>®) ~ ^ x G F. 

Here, we give an intuitive semantics of branching processes. Formal definition can be found 
in m, for example. A branching process A = (F,t) and an initial process xq G F give 
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rise to a discrete-time a Markov chain A4a,xo- Its state space is given by F* where a S F* 
can be regarded as a population of processes. We start from an initial population (xq) in 
F*, that means there is only one process of type xq. In each transition, each process in the 
population gives birth to child processes randomly. The probability that a process x gives 
birth to children represented by a population a S F* is given by t(x, a). 

For a type x € F, a probability of reaching x from xq is a probability Reach(A, xq, x) G 
[0,1] where a population that has a type x is reached in Ma,xo- 

From a S-labeled probabilistic tree automaton X, we can obtain a branching process A;^ 
by adding a new process _L that means aborting of the system and “forgetting” the labels 
on transitions. 


► Definition A.9. For a S-labeled probabilistic tree automaton X = (A, s, c), its skeleton 
is a branching process /S.x = (Tx,tx)- Here = X + {_L} and tx is defined as follows. 


Tx{x,a) = < 


EaGS„ c(x)({(a, xo,..., x„_i)}) 
1 - E/3GX- T-ix,l3) 

1 


0 

V 


(x G X,a= (xo,..., Xn-i) G X*) 
(xG A,a=(_L)) 

(x G {-L},a = (-L)) 

(otherwise) 


Using the skeleton Ax, we can define a value L(T,x)(Treeoo(S)). Namely, it is defined 
as the probability where _L is not reached from x in the induced skeleton. It remains to 
define L{X, x) for all cylinders cyl(t) G S^.- They are defined by the induction on the depth 
of t. Then, a probability measure L{X,x) on (Treeoo(S), 5oo) is uniquely determined. 

► Proposition A.10. Let X = (A, s, c) be a H-labeled probabilistic tree automaton. For each 
X G X, k G Lo and t G T'ree^(S), we define a value v^ff) G [0,1] by the induction on k as 
follows. 

H lfk = 0, then Vx{t) = 1 — Reach{Ax,x,l.). 

H Ift = {D,l) G 7ree^^(S) where l{e) = a G S„ and U is the i’th subtree oft, then 

n—1 

Vx{t)= ^ (c(x)({(a,xo,...,x„_i)}) • . 

— i—Q 


Then there exists a unique probability measure L{X, x) on (T'reeoo(S), 5^oo) s.t. L(X, x){cyl{t)) 
v{t). 


This proposition can be proved using Kolmogorov’s consistency theorem and the follow¬ 
ing lemma. 


► Lemma A.11. In Prop. A.10. for all k G lo and t G Tree^(S), we have 


J^xis) = i^xit). 

sG7Vee^bS).t^s 


•4 


► Proof. For s = {Ds,ls) G Tree^^(E), we denote Og for ls{e) and Ug for the arity of a, 
(i.e. Os G We prove the given equation by the induction on k. 
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For k = 0, as t and subtrees of s other than s are 0-prefix trees, 

sGTree^bS),t^s 


Tls —1 

= X! X! c(a;)({(as,a;o,...,a;„^_i)}) • 


seTree^(S) xq 

,...,Xns-lGX 

i=0 



(by definition of 

00 

EE 

n—O aGTin Xq,.. 

E c(x)({(a,Xo,.. 

.,Xn-lGX 

n —1 

■,Xn-l)}) ■ VxAA 



(as s consists of one node) 

00 

EE 

n—0 aeSn a^O)” 

E c(x)({(a,Xo,.. 

..x„_iGX 

n —1 

■)2;n_i)}) • ]^(1-Reach(A;t,a;i, A)) 


(by definition of Vx{t) where t G Tree^(S)) 


oo n— 1 

= E E E c(x)(‘|(ci, Xq, . . . , Xfi—l ) }) ' (1 R,6RCil(^;\;', Xi , E)) 

n—OxQ,...,Xn_iGXa^'^ri '^=0 

(as all elements are nonnegative) 

oo n— 1 

= E E (x, (Xq, . . . •, X XI — l)) ■ (1 Reach (^^ : -L)) 

n—0 GX 2—0 

(by definition of A;^) 

= 1 — Reach(A;t, a:, A) (by definition of branching process) 

= Vx{t) (by definition of Vx{t)) ■ 


For fc > 0, we assume that X^uGTree'' (s) u^v ^x{v) = Vx{u) holds for all u € Tree^ ^(S) and 
X G X. Let t = {D, 1) G Tree^(S), a = l{e) and assume that a G S„. Moreover, let ti and 
Si be the Fth subtrees of t G Tree^(S) and s G Tree^^(S), respectively. Then 


E 

s^Tree^^C^),t<s 

/ n-1 ^ 

= E E I c(x)({(a,xo,... ,x„_i)}) • i/2,,(si) 

seTree^bS),t^s \ 


i=0 


(by definition of Vxis)) 


E 1 2 : 0 , ■ • ■, a;„_i)}) 

XQ,...,Xn-lGX 


( 


E 

XQ,...,Xn-l£X 


E 

XQ,...,Xn-\£X 


( 


c(x)({(a,xo,... ,x„_i)}) 


V 


E W^^xAsi) 

^sGTree^+bS),ids 

E ■■■ E W'^xASi) 

soGTree^(i:), s„_i GTree^ (S), *=0 

\ to^so 

^ n-1 

n E '^xAs^) 

^i—0 Si^Tree^{Il),ti<Si 


\\ 


/ 


c(x)({(a,xo,... ,x„_i)}) 
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= E 

XQ,...,Xn-l£X 


{si does not appear in (s^) \i i ^ j) 

n—1 

n-. i{ti)) (by induction hypothesis) 

(by definition of 


i=0 


Therefore ^ 


sGTree^ (S),t;^s 


Vx{s) = Vx{t) holds for all fc G a; and t G Tree^(t). 


► Proof of Prop. A.10 Immediate from Kolmogorov’s consistency theorem [TB] and Lem. A.11 


► Definition A.12. Let X = (X, s,c) be a S-labeled probabilistic tree automaton. For 
a state a; G X, an infinite language of X from a; is a probability measure L(X,x) on 
(Treeoo(S),Uoo) in Prop. A.10 An infinite language of X is a probability measure L{X) on 
a (Treeoo(S), g’oo) that is defined by L{X){A) = J2xgx -^('^j2:)(A) for each A G S’oo- 

Then we can show that the language defined in Def. |A.12| coincides with coalgebraic 
infinite trace semantics. 


► Theorem A.13. The earrier of the final F-^-coalgebra in'M.ea.s is isomorphic to (T'reeoo(S), l?oo); 
and for a H-labeled probabilistic tree automaton X = (X, s,c), we have tr°°(c)(a;) = L{X,x) 

for all X G X. Moreover, tr°° © s(c)(*) = L{X). 

This theorem is proved using the result in m — the unreachable probability of a branch¬ 
ing process is calculated as the greatest fixed point of a certain function. 

► Lemma A.14 ([IT]). Let A = (r,r) be a branching process and y G T. We define a 
function P : [0,1]^ —>■ [0,1]^ as follows: 

\a\-l 

{P{^))x= r(a:,a) • . 

aGT*, i=0 

y does not appear in a 


Here, |a| denotes the length of a G T* and at denotes the i ’th letter of a. As P is a monotone 
function, P has the greatest fixed point G [0,1]^. Then we have 1 — Reach{A, x, y) = 


► Proof of Thm. A.13 We define an arrow ( : (Treeoo(S),3'oo) —t f^s(Treeoo(S),g’oo) in 
Meas by C(f) = (a, (to, ■ • ■ An-i))- Here, t = {D,l), a = l{e) G and for each i G 
{0,..., n — 1}, Hi = {a G N* \ ia G D} and li{a) = l{ia) holds. Then it is easy to see that 
C is measurable and moreover, is a final Fs-coalgebra. 

We show that a function L{X,_) : X —> 0Treeoo(S) is the largest homomorphism from 
c to JC- As X has a discrete cr-algebra, L{X,_) is indeed an arrow in Meas. 

Let G [0,1]^ be the greatest fixed point of a function P : [0,1]^ —>■ [0,1]'’'^ that is 
defined as follows: 


n—1 


{p{^))x = J2 E ( E I ■ n 

n—Oxo,---,Xn-iGX \aGSri 


( 1 ) 


i=0 


As L{X, a:)(Treeoo(S)) is defined by L{X, a;)(Treeoo(S)) = 1—Reach(A;t, a:, T), by Lem. A.14 
we have L(A, a:)(Treeoo(S)) = 

We first show that L{X,_) is a homomorphism. By Kolmogorov’s consistency theorem, 
it suffices to prove the commutativity with respect to cylinder sets: namely, we show that 
(JC~^ 0 PL{^^ — ) © c)(a:)(cyl(t)) = L{X , x){cy\{t)) for all A: G w and t G Tree^(S). 
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If fc = 0, then because cyl(t) = Treeoo(S), 

(JC”' 0 _))Qc){x) (cyl(t)) 

OO 

= E E E (c(x)({(a,a;o,... ,x„_i})) • (JC ^0 Fs(L(A’,_)))(a, Xq, ..., x„_i)(Treeoo(S))) 


n—0 xq,. 

..,Xn- 

iGX aGE„ 



OO 

E 

E 

E 

c(x)({(a,xo,.. 

n—1 \ 

.,x„_i})) • Y[ L(A’,x,)(Treeoo(S)) 

n—0 XQ:- 

..,Xn- 

iGX aGE„ 

V 

i^O / 

OO 

E 

E 

E 

c(x)({(o,xo,.. 

n—1 \ 

.,x„_i})).n(v““)x. 

n—0 Xq,. 

..,Xn- 

iGX aGE„ 

v 

i-O / 

(P(v““)), 





= (v““). 


while 

L(A’,_)(x)(cyl(t)) = (v“-),. 

Therefore we have (JC~^ 0 FL{X, ) © c)(x)(cyl(f)) = L(T’, x)(cyl(f)). 

Let k > 0, t = {D, 1), l{e) = a and a G Moreover, let ti be the z’th subtree of t where 
0 < i < n — 1. Then 

{JC^(DW{X,_))Qc){x){cyl{t)) 

n —1 

= E c(x)({(a,xo,...,x„_i)}) • L(A’,Xi)(cyl(ti)) 

XQ,...,Xn — l^X i—Q 

= L{X, x)(cyl(t)) (by definition of L{X, x)). 

Therefore we have JC~^ © FL{X,_) © c = L{X,_). 

Next we show that L{X, _) is the largest homomorphism. Let g ■. Treeoo(S) be a 
homomorphism from c to JC,. By the monotonicity of the extension of measure on cylinder 
sets, it suffices to show that g(x)(cyl(t)) < L(T,x)(cyl(t)) for all x G X, fc e w, and 
t G Tree^(S). We prove it by the induction on fc. 

If fc = 0, then cyl(t) = Treeoo(S). Then 

5r(x)(Treeoo(S)) 

= (JC~^ 0 F^g © c)(x)(Treeoo(S)) {g is a homomorphism) 

OO / \ n—1 

= E E E ■ • ■ 5 ^n— l) }) j ' (Tl'^^^oo (^)) 

n— 0 xQ,...,Xn-i^X VaeZl^ / i —0 

(by the definition of Fs on KI{G)). 

Therefore a vector w G [0,1]^ that is defined by = 5 (x)(Treeoo(S)) is a fixed point of 
P defined in Q. As is the greatest fixed point of P, we have g(x)(Treeoo(S)) = < 

Va; = L(A’,x)(Treeoo(S)). 

Let fc > 0 and assume that 5 (x)(cyl(s)) < L(A’,x)(cyl(s)) for all x G A and s G 
Tree^^(S). Moreover, let t = {D, 1), l{e) = a and a G S„. We denote U for the i’th subtree 
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of t where 0 < i < n — 1. Then 

g{x){cyl{t))= {JC~^ © F^g 0 c)(a;)(cyl(f)) {g is a homomorphism) 

= ( c(a:)({(a,a;o,...,x„_i)}) • ]j5(a::*)(cyl(f,)) I 

XQ,...,Xn-l \ i—0 / 

(by definition of Fs on 1 C^{Q)) 

- X! ( c(x)({(a,a;o, ■ ■ ■ ,a^n-i)}) • n i(T,x*)(cyl(f*)) I 

Xo,...,Xn-l \ i—0 / 

(by induction hypothesis) 

= (J(~^ © F^(L(X,_) © c)(a::)(cyl(f)) (by definition of Fs on IC£{G)) 

= L{X,x){cyl{t)) {L{X, ) is a homomorphism). 

Therefore tr°°(c)(x) = L{X,x) for each x £ X. This immediately implies tr°“(c) © s(*) = 
L{X) M 


A.3 Omitted Proofs in Section |4] 


► Lemma A.15. A polynomial functor F and V satisfy Assumptions^ and[^ in 


Prop. 4-2 


► Proof. It is known that Assumptionis satisfied [5]. It is known that Assumption [2jis 
satisfied na Lemma 2.4]. It is easy to see that F and V on Sets satisfy the Assumptions]^ 
1^ It is also easy to see that Assumptionj^is satisfied; T x,z '■ X-£ Z is given by T x,z(x) = Z 
for all X £ X. ◄ 


► Sublemma A.16. Let a be a limit ordinal, C be a finite set, and f : a C. Then there 
exists c £ C such that for all i < a, there exists b > i such that /(b) = c 

► Proof. For each c £ C, we define Ac C a by Ac = {b < a | /(b) = c}. Assume that for 

all c £ C, there exists ic < a such that for all j G Ac, j < F holds. Then UjeAe i — F ^ “ 
for each c £ C. As C is finite, this implies a = Uj<ai ~ UcGcUjGAei — UcgcF ^ 
contradicts and the statement is proved. ◄ 

► Lemma A.17. In Def. |/.7t if T — V and F is a polynomial functor. Assumption [7] is 
satisfied if b{x) f=- 0 for each x £ X, while Assumption^is satisfied if b{x) is finite for each 
x£X. 


Proof. Assume that b{x) yf for all x £ X. To prove that Assumption in Def. 4.7 


IS 

satisfied, it suffices to prove z G Ty,z © b{x) for all z G ^ and x £ X. By the assumption, 
there exists y £Y such that y £ b{x). Therefore for all z G .Z, z G T Y,z{y) C T y,z © b{x). 
Next we assume that b{x) is finite for each x £ X and prove that Assumption in 
is satisfied. Here, ni<a(5a © 0{x) = r\i<aUyeb{x) 9i{y) while (ni<„'7i) © H^) = 
\<a9iiy)- If is well-known that the latter is always included in the former. There- 


4.7 


Def. 

LJyGfe(: 

fore it suffices to prove that z G ni<a UyG6(^) implies z G UyGh(^) Hkc 9i{y)- 

Assume that z G ni<a Ui/G&(a;) Then for each i < a, there exists yi £ b{x) such 

that z G gi{yi). As b{x) is finite, from Sublem. A.16 for an arbitrary i < a, there exists an 
ordinal j such that i < j < a and z £ g-^{y). As i < j implies g\, □ g), we have z G gi{y). 
Therefore z G UyG6(^) nv<a 9iiy) holds. ◄ 
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► 


Proof of Thm. 


4.10[ (soundness). 


F(tr“(c)) 



Let C : Z —)■ FZ be a final F-coalgebra. By definition, dlppE = {F{X),c(-) s,Fc). By the 
assumption and the soundness of a forward Kleisli simulation, we have 


tr°° (J^c) © (c © s) C tr“ (d) 0 f . 


( 2 ) 


As tr°°(c) is a homomorphism from c to J(, we have 


tr°°(c) = (JC)-i©F(tr“(c))©c. 


(3) 


Here, (J^) ^©F(tr°°(c)) is a homomorphism from Fc to C because of the following equation. 


JC © ((JC)-' © i^(tr~(c))) = F(tr~(c)) 

= F((JC)-'©F(tr“(c))©c) (by(§) 

= F((JC)-'©F(tr“(c)))©F(c) 

As tr°°(Fc) is the largest homomorphism from Fc to J(, this implies 


(JC)”^ © ■F’(tr°°(c)) © tr“(Fc) . 

From the equations ([2]Q, tr°“(d) © s © tr°“(d) © t follows. 

1^ (adequacy). Let f : Y-n X he a. forward Kleisli simula¬ 
tion from X to y. Then as / is a forward simulation, 

Fc © (c © /) © Fc © (F/ Qd) QF{c(D f)(Dd 

and 

c©s© (c©/)©f. 

Hence c©/:F-H>FXisa forward simulation from Afpe to 


3 ^. 


Proof of Thm. 4.11[ (soundness). 


(4) 



F(tr”(d)) 
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Let b : X-¥>- FY be a TIF-backward simulation from X to J^fpe- Then by the soundness of 


TIF-backward simulation (Lem. 5.7), we have 


tr°°(c)0sEtr“(Fd)©(d©t). (5) 

It is easy to see that d : F-H> FY is a forward simulation from J^fpe to y. Therefore by the 


soundness of forward simulation (Lem. 4.4), we have 
tr°°{Fd) Q (dQt) C tr°°{d) © t. 

From equations © and ©, we have tr'^(c) © s © tr°°(d) © t. 

(adequacy). Let b : X-n Y he a TIF-backward simu- 
lation from T to 3^. In the similar manner to the proof of 
Thm. |4.10|f| 


we can prove that dQb : X -p FY is a backward 


simulation from X to J^fpe- Moreover, the Assumptions [2a] ^ 
and 1 2b I imply that d© 6 satisfy Assumptions and in the 
definition of a TIF-backward simulation (Def. |4.7[ ). There¬ 
fore d©6 is a TIF-backward simulation from X to J^fpe- < 


( 6 ) 


-^^FY ■ 




Fd 



^FY 


A.4 Omitted Proofs in Section |5] 


► Proof of Prop. 


5.2 


Let c : A-p FX be a F-coalgebra in KI{T). 


We first construct a cone (A, (a^ : A -p over the sequence 1 FI 

_ We define a function d'x : X£{T){X, 1) —>• Xi{T){X, 1) by x{f) = T!_fi © 

FfQc. 

As composition in X£{T) and F's action on arrows are both monotone (by Assumption 31, 
Tjf is also monotone. Moreover, as Jlx is the largest element in iC£{T){X, 1) (Assumption 41, 
we have Jlx 3 '^x{Jlx)- Therefore by repeatedly applying d'jc to the both sides, we can 
obtain a decreasing sequence Jlx 3 'I'jf(J!x) 3 ■ ■ ■ ■ By Assumption]^ their 

greatest lower bound ^'^(Jlx) = x) exists. Here, as composition of arrows in 

X£{T) and F’s action on arrows are both a;°P-continuous, d'x is also locally a;°P-continuous. 
Hence by Kleene fixed point theorem, '^'^{Jlx) is the greatest fixed point of d'x. 


c — Fc _o F c _Q F c 

X -^^ FX -^—5- F A-^^ F A 

\j'-x zi \jF\x □ \jF^\xZ} \jF^\x 


J'-Fi X JFlpi _2 JF^'.fi _o JF^\i 

1 ^^- FI <-^-F I ^^- F I ^ 


M!z - 


JF\z — 


JF^'.i 


JF^\2 


-\ - > pz -1- ^ P 7 -1-^ P 7 —tP ■ 

,/C JFC F 7 t Z 


Using this greatest fixed point, for each i < ui we define an arrow : A-p F 1 inductively 
as follows: 


ao = and Q!i+i = Faj©c. 

Then for each i G uj, we can prove ai = F JlpiQ Oi+i inductively as follows. 


( 7 ) 
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For i = 0, we have: 


J!fi © Qfi = J^-Fi © © c 

= ^xiJ'-x) 

= Oq 


(by definition) 
(by definition) 
('^'x('^-x) is a fixed point) 
(by definition). 


Assume that at = F J\pi Q ai+i. Applying F and composing c from the right, we have 
tti+i = F J!i © ai+2- 

Hence we have = A*J!Fi©ai+i for all i G uj. This means that (X, (oi : X-p F\)i^^ 

is a cone over the sequence 1 FI F^l .... Therefore by Assumption!^ 

there exists a unique mediating arrow I ■. Z from the cone (X, {ai)i^ijj) to {Z, 



Here, for each i G uj, we have 


Jii © {JC" 


QFlQc)= F*+V!fi © FJji QFlQc 

(C is a mediating arrow) 

= F^^J\FiQFaiQc 

(Hs a mediating arrow) 

_2 + 1 

= F J!fi © oti+i 

(by definition of Oi+i) 

- 0^2 

((X, (aj)jgtd) is a cone). 


Therefore, J( ^ QFIQc is a mediating arrow from (X, (ai)igtj) to {Z, too. Hence 

by the uniqueness of the mediating arrow, I is a homomorphism from c to j’C- 

To conclude the proof, we have to show that this I the largest homomorphism from c to 
J^. Let g : X-p Z be a homomorphism from c to J(. We construct a cone (X, {/3i : X-p 

F*l)igtj) over the sequence 1 FI F^l ... by /3i = Jy, © g. Then for each 

i G UJ, we can prove Pi © ai by the induction on i as follows. 

For z = 0, we have 


^'x(/ 3 o) = J'-Fi © FJ70 QFgQc 
= J\ FI © FJ70 © JC ©5 

= J70 ©5 

= Po 


(by definition) 
(g is a homomorphism) 
(1 is a final object in C) 
(by definition). 


Therefore po is a fixed point of 'I'x. As oq = is the greatest fixed point of Tx, we 

have Pq © oo- 
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Assume Pi C Then we have: 


Pi+i = Jli+i & 9 
= F-fi QJ(Qg 
= Fji Q FgOc 
= FPi © c 
© Ftti © c 

= Oii+i 


(by definition) 
(C is a mediating arrow) 
(g is a homomorphism) 
{{X, {Pi)i(z^) is a cone) 
(by inductive hypothesis and that F is monotone)) 

(by definition). 


Hence Pi © ai holds for each i G w. This implies Jji Q g Q J'ji © I for each i G oj. As 
{Z, {Jji : Z-G F*l)ig(^) is a 2-limit (Assumption]^, we have g Q L Hence I is the largest 
homomorphism from c to J(^. 



•4 

► Lemma A.18. A polynomial functor F and Q on Meas satisfy Assumptions^ 

in Prop. |5.^[ 

► Proof. It is known that Assumption is satisfied 

It is also known that there exists distributive law A : FQ ^ QF exists [B]. Therefore 
Assumption 1^ is satisfied. 

Next, we prove that Assumption is satisfied. Assume that a family of Kleisli arrows 
{fi : (A, (K, g'y))ig,j constitute a decreasing sequence. We can define their greatest 

lower bound fliGi,; fi ■ X-gY in a pointwise manner: namely, for x G X and A G ^y, 

(fi ■ 

' ' l—¥00 

It is easy to see that polynomial F preserves this pointwise greatest lower bound. It remains 
to prove that ^ measurable function from (A, 3^x) to G{Y, 5y). Moreover, we also 

have to prove the local continuity of composition. They can be proved in the similar manner 
to the proof of O Proposition 9]. Therefore Assumption is satisfied. 

It is easy to see that Assumption is satisfied. 

We prove that Assumption is satisfied. If FI is empty, then the limit Z is also empty 
and Assumption is satisfied. Assume that FI is not empty. It is known that the sub- 
Giry monad G preserves a limit over an ^“P-sequence consisting of standard Borel spaces 
and surjective measurable functions m- In our setting, for each j S w, F®I is a standard 
Borel space because 1 and all of are standard Borel spaces, and moreover, standard 
Borel space is preserved by countable coproducts and countable limits UHl 12.B]. Moreover, 
for each i G uj, F'^lpi is surjective. Therefore the limit (2', ( 7 ^ : Z -G F'^l)i^ui) over the 















N. Urabe and I. Hasuo 


29 


final sequence 1 ^ FI ^ F 1 ^ 

that J : Meas —?> JC£{Q) preserves the limit. 
2 -limit. 


is preserved by Q. This immediately implies 
It is easy to see that the resulting limit is a 

< 


► Proof of Thm. 5.3 In the similar manner to the proof of Lem. A.18 we can show that F 
and Q satisfy the assumptions in Lem. |4.4| Therefore immediate from Lem. |4.4[ ◄ 


► Proof of Lem. 5.7 
tr°°(d) in the proof of Prop. 5.2 

For each i G 


We prove tr°°(c) C tr°“(d) 0 b along the construction of tr°“(c) and 


oj, we define 41^ 


(J!x) : X -H> 1 and 4'y(J!y) : F-f> 1 as in the proof of 
Prop. 5.2 We can prove that 4'^(J!x) C 4'y(J!y) 0 b for all i S w by the induction on i 
as follows. 


For z = 0, by Assumption we have = 'I'y(J!y) 0 b. 

Let z > 0 and assume that C 4 '^^(J!y) 0 b. Then 


^^(J!x) = J'-Fi © F(^ J!x)) 0 d 

E Jl FI 0F(rfi(J!y))0F6 0c 
^ JIfiQ F(4'^^(J!y)) Qdeb 


(by definition of 'I'x ) 
(by induction hypothesis) 
(5 is a bwd. simulation) 
(by definition of 'I'y). 


Therefore we have 4'^(J!x) E 'I'y(J!y) 0 b for all i G uj. 



We define cones (A, {af : X -G F l)ig(^) and (Y, {af : Y -G F iLg^) over the sequence 


1 FI F^l ... as equation (71 in the proof of Prop. 


5.2 


As is shown in the proof of Prop. 5.2 
from a cone {X,{af : X -p F*l) 


tr° 


(c) : A -O' F is the unique mediating arrow 
ig(^) to a 2-limit : Z-G F*l)ig^). Moreover, 


tr“(d) : F -0 Z is the unique mediating arrow from a cone (F, (of : F -o F*l)ig^) to 
{Z,{Jji : F-0 F*l)ig,^) and therefore tr°“(d) 0 & : A-o Z is the unique mediating arrow 
from a cone (A, (of 0 b : A-o F*l)ig,^) to (Z, {Jji : Z-o F*l)ig,^). 

For all i G to, we can prove E ctY 0 6 by the induction on z as follows: 
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For i = 0, 

ajf = n (by definition) 

© b) (by the above result) 

= (n ^y{J\y)) © b (by Assumptionin Prop. |5.2D 

i^LO 

= © b (by definition). 

Let i > 0 and assume that af_i © ctj-i © b. Then 


= Fa^_^ © c 

(by definition) 

© Fa'(_i Q FbQ c 

(by inductive hypothesis and the monotonicity of F) 

© Fa(_i Q dob 

(& is a backward simulation) 

II 

P 

© 

(by definition). 


Therefore we have af Q aj Q b for all i G lo. As {Z, (Jy^ : Z-G is a 2-limit, 

this implies tr°“(c) © tr“((i) © b. 

The last claim follows from b’s condition on initial states. 



•4 


► Lemma A.19. In Def. |5. ^ if T = Q and F is a polynomial functor, Assumption^is 
satisfied if b{x){Y) = 1 for each x G X. 


► Proof. We assume that b{x){Y) = 1 for each x G X. By the definition of multiplication 
of the sub-Giry monad (see Def. 2.31, for x G X, 


J\y © b{x){l) = b{x){\y\l)) = b{x){Y) = 1 = J\x{x){l). 


Therefore Assumption is satisfied. 


•4 


A.5 Lift Monad and a Tree Automaton with Exception 
A.5.1 Definitions 

In this section, we give a definition of the lift monad and the order on the homsets of the 
Kleisli category. 
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► Definition A.20 (lift monad). A lift monad is a monad on Sets such that 

. CX = {1.} + X, 

. £/(!/) = 

IA (otherwise), 

H r]x{x) = X, and 

- = 2 - 

► Definition A.21 (order enrichment of KI{C)). We define an order on Xi{C){X,Y) by 
f Y g 'U ^x & X.f{x) = Aor/(x) = g{x). 


A.5.2 Construction of Infinite Traces 

In this section, we show that a polynomial functor F on Sets and the lift monad C satisfy 
the assumptions in Prop. hence constitute an infinite trace situation. 

► Proposition A.22. A polynomial functor F on Sets and a lift monad C satisfy Assump¬ 
tions^ in Prop. |5.^ with respect to the order in Def. \A.21\ Therefore, F and 

C constitute an infinite trace situation. ◄ 

► Proof. It is easy to see that F and C on Sets satisfy the Assumptions and 

To prove that Assumption |^is satisfied, it suffices to prove that for each x G X, \~\^^,^{gi(^) 
h){x) = Tiff {^\ieu>9^)®b{x) = -L. lfb{x) = A, then ^\ieJ9^®b){x) = (Uieu: 9i)®b{x) = A. 
Assume b{x) yf A. Then 

© b){x) = ±^3i G uj.gi{b{x)) = A P| gi{b{x)) = A (P| gi © b){x) = A . 

It is known that Assumption is satisfied m Lemma 2.4]. 

As a connected limit and a coproduct commute in Sets [T], the Kleisli inclusion functor 
J : Sets —> K£{T) preserves w-limit. It is easy to see that this limit is a 2-limit. Therefore 
Assumption 1^ is also satisfied. ◄ 

A.5.3 Coalgebraic Infinite Trace Semantics and Automata-theoretic 

Semantics of Tree Automata with Exception 

Next we characterize the coalgebraic infinite trace semantics using automata-theoretic terms. 
For a ranked alphabet S, (A, iA;)-system can be regarded as a automaton with exception 
that generates an infinite tree. 

► Definition A.23. A (A, Fs)-system X = {X, s, c) is called a tree automaton with exception. 
For a S-labeled infinite tree t = (A), 1) and a state x G X, a. (A)„gij-labeled infinite tree 
tr = {D,lr) that has the same domain as t is called a run of X from x that generates t if 
H lr{e) = X, and 

H for each a G D where l{a) = a G S„, lr{a) = y and lr{ai) = pi for each 0 < f < n — 1, 
we have c{y) = (a, yo,..., yn-i) A. 

For a state x G X, an infinite tree t is called an infinite output of X from x and denoted 
by Out(A’,x) if there exists a run of X from x that generates t. 

An infinite tree t is called an infinite output of X and denoted by Out(A’) if s(*) yf A 
and t is an output of X from s(*). 

The notations Out(A’,x) and Out(A’) in the above definition are justified by the following 
lemma. It is easy to prove, so we omit the proof. 
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► Lemma A.24. Let X = (X, s, c) he a tree automaton with exception. For a state x G X, 
if an infinite output of X from x exists, then it is unique. Moreover, an infinite output of 
X exists, then it is unique. ◄ 


We show that for a tree automaton X = {X, s, c) with exception, the infinite output of 
X is the largest homomorphism from c to JC,. 


► Theorem A.25. Let X = {X, s, c) be a tree automaton with exception. 
With respect to the order in Def. \A.21\ for each x G X, we have 


tr~(c)(x) 


Out{X,x) {an infinite output of A from x exists) 
_L {otherwise). 


Moreover, 


tr'^(c) © s(*) 


Out{X) {an infinite output of A exists) 
_L {otherwise). 


► Proof. We define h : X-pTreeoo(S) by 


h{x) 


Out(ft’, a;) (an infinite output of A from x exists) 
_L (otherwise). 


We show that h is the largest homomorphism from c to JC where C is a F^-coalgebra defined 
in the proof of Thm. |A.13| 

We first show that h is a homomorphism. Assume that h{x) = t = {D,l) _L. Then 

there exists a run t^ = {D,lj.) of X from x that generates t. By definition, we have c{x) = 
c{lr{e)) _L. Hence we define n G ui, a G S„ and Xq, ... ,Xn-i € A by {a,Xo, • ■ • ,x„_i) = 
c{x). As tr = {D,lr) is a run of X from x that generates t, i’th subtree of tr is a 
run of X from Xi that generates i’th subtree ti of t. Therefore h{xi) = t^ ^ 1. for each 
i G {0,..., n — 1}. Then 


Fh © c{x) = Fh{a, xq, ..., x„_i) = (a, to,..., t^-i) = J{C){t) = J(C) © h{x). 

Assume that h{x) = T. If c{x) = _L, Fh © c{x) = Jf Q h{x) = T holds by definition. 
Assume that c{x) = {a, xq, ..., Xn-i) yf -L where a G S„. If h{xi) = F ^ ± for all 
i G {0 ,... ,n — 1}, there exits a run of X from Xi that generates F for each i. Then a 
tree {x, Fp,..., tr,n-i) is a run of X from x that generates t, and it contradicts to h{x) = _L. 
Therefore there exists i such that h{xi) = T and we have Fh © c{x) = JC © h{x) = T. 

Hence h is a homomorphism from c to JC- It remains to prove that h is the largest 
homomorphism. Let g : X-G Treeoo(S) be a homomorphism from c to Jf. It suffices to 
prove that g{x) = t = {D, 1) y^ T, then h{x) = t, too. To this end, we construct a run 
tr = {D,lr) of X from x that generates t. For each a G D, we define lr{a) G X such that 
g{lr{a)) y^ T by the induction on the length of a as follows. 

For a = e, we define it by lr{s) = x. By assumption, g{lr{e)) = g{x) y^ T. 

Assume that l{a) G S„ and g{l{a)) yf -L. As 5 is a homomorphism from c to JC 
and g{l{a)) y^ T, there exists Xo,...,x„_i such that c{lr{a)) = {l{(3),Xo, ... ,Xn-i) and 
g{xi) y^ _L for each i. We define lr{ai) by lr{ai) = Xi. 

By axiom of dependent choice, this is well-defined and moreover, by its construction, 
{D, Ir) is a run of X from x that generates t. Therefore t G L{X, x) for each x G X and we 
have g © L{X, _). 

Hence tr°°(c) = L{X, ). This immediately implies tr°°(c) © s{*) = L{X). 








N. Urabe and I. Hasuo 


33 


A.5.4 Kleisli Simulation for Systems with Exception 


It is known that a polynomial F and £ satisfy assumptions of Lem. |4.4| [T^ . Hence we can 
use forward Kleisli simulation to check infinite trace inclusion between tree automata with 
exception. 

For a (£, F')-system, as we have seen in Prop. A.22 the largest homomorphism can be 
constructed using Prop. |5.2| Therefore from Lem. lEZl we can use T-backward simulation 
in Def. 5.6 to check infinite trace inclusion. For a (£, F)-system, the sufficient condition for 
a backward simulation b to satisfy the assumption in Def. |5.6|can be given as follows. 


► Proposition A.26. In Def. \ 5.(\ ifT = C and F is a polynomial functor, then Assumption 
is satisfied if b{x) _L for each x G X. 


► Proof. Let * be the unique element in the final object 1. It suffices to prove that Jly © 
b{x) = * for all x G X. By the assumption, b{x) yf _L. Therefore * =!v(&(a;)) = Jly © 
b{x). ◄ 


A.5.5 Forward Partial Execution for Systems with Exception 

From Thm. |4.10[ soundness and adequacy of FPE for forward simulation hold. 

By the construction of the largest homomorphism, soundness and adequacy of FPE for 
backward simulation hold if the simulating automaton satisfies the assumptions in Thm. [5^ 
For a (£, F)-system, the assumptions can be described as follows. 


► Proposition A.27. IfT = C and F is a polynomial functor, the assumption in Thm. 
is satisfied if d{y) yf T for each y gY. 



A.6 Subdistribution Monad and Infinite Trace Situation 


We first give definitions of the subdistribution monad and orders on the homsets of the 
Kleisli category. 

► Definition A.28 (subdistribution monad). A subdistribution monad is a monad {'D,ri^, pP) 
on Sets such that 

_ VX = {p:X^[0,l]\ < 1}> 

. = = and 

10 (otherwise), 

- = Y.pe'DX ^(P) ■ Pi^)- 

► Definition A.29 (order enrichment of K£{D)). We define an order on ]C£{V){X,Y) by 
/ © 5 ^ yxG X.Wy G Y.f{x){y) < g{x){y). 

For a ranked alphabet S, we show that Fy on Sets and the subdistribution monad D 
constitute an infinite trace situation by giving an explicit definition of the largest homomor¬ 
phism. 

► Proposition A.30. Let Y be a ranked alphabet and Fs be a functor on Sets defined in 
DefW^ Then Fy and the subdistribution monad D constitute an infinite trace situation. 

► Proof. We define C, : Treeoo(S) —t Fi;Treeoo(£) in Sets in the same way as the proof 
Then C is a final Fs-coalgebra. For each Fs-coalgebra c : A -o- FyX, we 

construct the largest homomorphism h : X-G Fi;Treeoo(S) from c to Jf. 


of Thm. A. 13 
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For each x & X, an integer fc € w and a fc-prefix tree € Tree^(S), we define a value 
G [0,1] by the induction on k as follows: 

_ if k = 0, then = 1, and 

_ if l^) G Tree^(S) such that l^{e) = o G S„ and the i’th subtree of is 

n —1 

^x{t'^)= XI (c(a;)(a,a:o,...,a;„-i) • ■ (8) 


For t' G Treeoo(S) and k £ uj, we denote prefixf.(t') = (prefixj,(£)'),prefixj.(r)) for a 
unique A:-prefix tree that is a prefix of t'. As Y^neu, Y.xo,...,x^-iex c(x)(a, xo,---, a:„_i) 

1, the sequence (^a;(prefixj,(t)))^g^ is decreasing with respect to k. Therefore we define 
h : A-p Fi;Treeoo(S) by h{x){t) = limfc^oo ^x{prefix^{t)). 

We first show that this h is a homomorphism. For each x £ X, n £ ui, and t = {D, 1) £ 
Treeoo(S) such that 1(e) = a £ Sn and i’th subtree of t is ti, 


JC ^ Q F^hO c{x){a,to,... ,tn-i) 

n—1 

= X c(x)(a,xo,...,Xn-i) ■W_h(x^)(ti) 

XQ,...,Xn — l^X 2=0 

71 — 1 

= X c(x)(a,XQ,...,Xn-i)'W lim ^^.(prefixj,(ti)) 

^ ^ /c—>-oo 

XQ,...^Xn — \^X 2=0 

n—1 

= lim X c(a;)(a,a:o, • ■ • ,a;n-i) • TT ^a;i(prefixj,(ti)) 

Xo,...,Xn-lGX 2=0 

= lim ^x(t) 

k—^oo 

= h(x)(t) 


(by definition) 


(by definition of h) 


(by definition of 
(by definition of h). 


To conclude the proof, we show that h is the largest homomorphism. Let g : X -£ 
Treeoo(S) be a homomorphism from c to JC. We prove g(x)(t) < h(x)(t) for all x G A and 
t £ Treeoo(S). To this end, we first prove g{x){t) < Cx(prefix^,(t)) for all fc G w, a: G A and 
t £ Treeoo(S), by the induction on k. 

If fc = 0 then for all x and t, g(x)(t) < 1 = Ca:(prefixj,(t)). 

Let fc > 0 and assume that g(x)(t) < Ca;(prefix^,_^(t)) for all x and t. Then 

9(x)(t) 

= JC,~^ © Asg © c(x)(t) (g is a homomorphism) 

71 — 1 

X c{x){a,xo,...,Xn-i)-\{ g(xi)(ti) (by definition) 

XQ,...^Xn — \^X 2=0 

n—1 

< E c(a;)(a,a:o,... ,x„_i) • n Cx, (prefix^_ 2 (ti)) (by induction hypothesis) 

XQ,...,Xn — l^X 2=0 

= Cx(^) (by definition of C) 


Hence for all x and t, we have g{x){t) < limfc_>oo Ca:(prefixj.(t)) = h(x)(t). ◄ 

We have shown that Fy, and V constitute an infinite trace situation. However, the largest 
homomorphism to JC cannot be constructed in the general ways introduced in this paper. 
It is easy to see that there exists A and Z in Sets such that Ki(T>)(X, Z) does not have 


Fx,z- Therefore we cannot construct the largest homomorphism by using Prop. 4.2 
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Moreover, in fact, we cannot construct the largest homomorphism X 


even by using Prop. |5.2| Let F be an endofunctor on Sets that is ^ i r -q- \ i 
defined by F{_) = {p,q} x (_). Then, the limit of the final sequence 

1 '^2 FI f"^! ... is given by : Z —>■ F'^l)i^^) where 

Z = {p, q}‘^ and 7 i(aoai • ■ ■) = aoOi... ai-i. We define X G ]C£{'D) and c : X -n FX by 
X = {*} and c(*)(a, *) = | where a G {p,q}- Moreover, for each z G w, we inductively 
define : X-f> f*! by Og = J^-x and a^+i = Fai © c. It is easy to see that {X, is 

1 .^©1 “ F ?^ 1 tt - j . ■ 1 1 . J .1 j . 

a cone over a sequence iGt-i*! Gi- t 1 Gi- .... However, it is also easy to see that 

there does not exist f ■. X-<^ Z such that Jq, Q f = o-i- This means that Assumption is 
not satisfied. 

As a consequence, we can construct the largest homomorphism from c to JQ neither by 
using the construction in Prop. |4.2|nor Prop. |5.2[ 


A.7 Examples and Counterexamples 

► Example A.31. In the construction of the largest homomorphism in Prop. |4.2[ we need 
w + 1 times of iterations for the nondeterministic automaton X on the left below. We need 
2a; + 1 times of iterations for y on the right below. In a similar manner, for each ordinal a, 
we can construct an automaton for which we need a times of iteration. 



► Example A.32. There exists a (not total) backward simulation from the nondeterministic 
automaton A to 3^ below. However, the simulated automaton X outputs an infinite word 
aaa ... while y does not. Therefore the infinite trace of X is not include in that of y. 


Cl 


X 

/ G- O G- o ■ 


3 ^ 


■ o G— 


There exists a (not image-finite) backward simulation from Z to W below, while trace in¬ 
clusion from Z to W does not hold. 



► Example A.33. The infinite trace of the nondeterministic automata X below is included in 
the infinite trace of 3^. There exists no forward simulation from A to 3^ but a TIF-backward 

simulation does exist. 

A 3^ 
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